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ABSTRACT 

A recent wave of linguistic research has attempted to 
demonstrate empirically that in learning the syntax of a second 
language, adults re-access their universal grammar (UG). However, the 
conspicuous lack of success of second language learners has caused 
researchers to seek evidence in experimental data. The most expedient 
source of this data is grammatical ity judgments, and they present 
problems of reliability and validity. More trustworthy elicitation 
techniques have been developed, but grammatical ity judgments are 
still being used with few methodological safeguards. The most serious 
barrier to the development of a "principled theory 91 of second 
language learning appears to be reliance on unprincipled data. 
(MSB) 
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INTRODUCTION 

In current second language research, there is much ado about the quest 
for a "principled theory" to account for adults' acquisition of non-native 
syntax (see, e.g., Flynn 1985b). It is understood that such a theory should 
emerge from a formal model of language acquisition, and should be capable 
of making testable predictions of, and providing adequate explanations for, 
the linguistic behavior of learners. For first language (LI) acquisition, a 
stellar example of such a theory is Steve Pfnker's (1984) Language 
LearnabiliU j and Lan guag e Development . For second language (L2) 
acquisition, no such fleshed-out version yet exists. 1 However, there is 
agreement among a considerable number of researchers as to the point of 
departure for a legitimate L2 acquisition model. This point of departure 
turns out to be the same as that posited by Chomsky (1980, Inter alia ) for 
LI acquisition, namely, Universal Grammar. 
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Universal Grammar (UG) has been proposed as a solution to what Is often 
referred to as the logical problem of first language acquisition: how Is the 
child able to produce more sentences than have been available in input, and 
how Is (s)he able to puzzle out the complexities of the mother tongue Hi s* 
brief a period of exposure? The answer resides In the postulate thai tin 
child Is genetically endowed with a set of cognitive principles which «* 
specific to the domain of language learning, and which are identified *s 
Universal Grammar: 

Universal Grammar Is taken to be the set of properties, conditions, or 
whatever that constitutes the 'Initial' state of the language loamer, 
hence the basis on which knowledge of language develops. (Owasku 

1980:69). " 

UG defines a limited range of possible grammars of natural languages, and 
thus reduces the learner's pure guesswork In comprehension and production 
of novel utterances. The operation of UG In language acquisition Is said to 
involve learners' setting of parameters and their distinguishing between 
core and peripheral grammar (see below). 

A recent wave of researchers has attempted to demonstrate empirically 
that, In learning the syntax of a second language, adults re-access UG, 
White (1985b) examines L2 acquisition of the UG parameters of SUBJACENCY 
(which deals with the number and type of bounding nodes across which 
sentence elements can be extracted) and PRO-DROP (which allows for 
omission of the subject pronoun, free Inversion of subject and verb in 
declaratives, and "that-trace" effects, where a subject Is extracted out of a 
clause containing a complementizer). Her claim Is that L2 acquisition 
Involves parameter-setting (the learner must determine, for example, 
whether the target language Is a PRO-DROP language), except that with a 
second language the learner Eg-sets parameters that differ from the native 
tongue. A similar line of research Is undertaken by Flynn (1985a), working 
with the parameter of PRINCIPAL BRANCHING DIRECTION. Mazurkewlch 
(1985) has sought to demonstrate that no matter what the native language 
of the L2 learner, unmarked (or core grammar) structures such as Direct 
Object Passive (e.g. The ball was thrown by John') will be acquired before 
marked (or peripheral) structures such as Dative Passives (e.g., The ball 
was thrown to John' or 'John was thrown the ball'). Felix (1984), working 
with native speakers of German, Illustrates seven structural constraints of 
UG with grammatical and ungrammatlcal target language (English) 
sentences; these sentences have no equivalent in German and have not been 
explicitly taught to the ESL subjects. Among the constraints Illustrated are 
SUPERIORITY EFFECTS (e.g. '*l don't know what who did' ys. 'I don't know 
who did what'), EXCEPTIONAL CASE MARKING (e.g. '*Fred was easy for Bob to 



expect to come to the party' versus 'Fred was easy for Bob to persuade to 
come to the party'), and the SPECIFIED SUBJECT CONDITION (e.g., '*Who did 
the man see John's pictures of?' versus 'Who did the man see pictures of?'). 
ESL subjects, when asked If the representative sentences were grammatical 
or ungrammatlcal, performed better than chance overall. Their performance 
on this task Is attributed to their accessing of the relevant constraints In 
Universal Grammar. 

Despite the significant contributions of such lines of research, and 
despite the increasing acceptance of the role of UG In first language 
acquisition, there are serious obstacles to Its application to second 
language acquisition. The present paper offers a number of perspectives on 
the interplay— and frequent mismatches—of empirical linguistic data and 
L2 acquisition theory. Though many of the observations will be applicable 
to quite a variety of current theories of second language acquisition, 
emphasis will be on the prevailing UG paradigm. Moreover, since much of 
the core data within this and other paradigms has been In the form of 
learners' grammatical ity judgments, their limitations and proper 
interpretation will be discussed. Time constraints will, unfortunately, 
limit discussion to fairly narrow domains of learner output data, to the 
complete exclusion of input data . x 



END-PRODUCT DATA AND THE UG/L2 PARADIGM 

A major impediment to second language acqulstion theory based on 
Universal Grammar Is the conspicuous lack of uniform success among L2 
learners. We will recall that UG theory, as applied to LI, Is above all a 
response to the logical problem of uniform rapid progress and success 
among children learning their mother tongue. No such miracle characterizes 
L2 acquisition. The end products of adults' attempts at L2 acquisition range 
from virtual zero mastery to native-like mastery, with the distribution of 
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learners falling roughly within a normal bell curve (see Scovell 1985). It is 
fair to say that, relative to the uniform success of LI children, L2 adults 
display varying degrees of failure. A UG account, therefore, is not 
motivated on the same empirical grounds for L2 as for LI.- 3 

It may be argued, then, that at best a UG model is not necessary to 
account for generally unsuccessful acquisition of an L2; at worst, it is 
inappropriate to invoke a paradigm of linguistic behavior that is essentially 
phylogenetic and deterministic in the face of end-product data that are 
essentially idiosyncratic and indeterminate. Additional arguments in favor 
of this position may be found in Bley-Vroman (1986a). 

A counterargument to the above might run as follows. Though end- 
product data suggest that (most) adult L2 learners do not apply UG in the 
manner suggested by Chomsky for LI children, this is not to say that adults 
cannot access UG. If we assume that adults have ability to access UG, then 
we open the door to quite a variety of logical possibilities, the 
permutations depending on whether (a) some or all adults can access UG; 
(b) UG is accessed fully or partially; (c) UG Is applied fully or partially. 
Note that no claim about the structure or content of UG Is being made; 
rather, an enhanced range of posslbilltes of access and application is being 
considered. The appeal of such a weakened version of UG's role In L2 
ocqulstlon is its flexibility, which would allow one to account for the 
variability of success attested among learners of a second language. 

The dangers inherent in such an argument are obvious. Any theory, 
however preposterous or plausible, could account for data if applied on an aj 
!m (learner-by-learner, structure-by-structure) basis. Moreover, the 
weakened version offers a tempting invitation to adduce validating evidence 
via post hoc ergo propter hoc reasoning. 

Nevertheless, one should not overlook a compelling feature of the 
weakened version, namely the premise that it Is possible for L2 learners to 
access UG. Since application of UG assumes its availability, establishing 
the validity of this premise becomes a logical necessity. Further, certain 
L2 acquisition theories (e.g. Felix' H985bl competition model) are built on 
the argument that UG is indeed accessible, but that other cognitive 
structures compete with it when the learner Is confronted with L2 learning 
tasks. It is not surprising, then, that considerable research has been 
directed toward demonstrating that adults can access UG, leaving open the 
Issue of whether they can or do enply it to L2 acquisition. 

* it Is nonetheless true that, as in L 1 acquisition, the range of L2 learners* utterances can 
exceed that found in their Input. This fact Is not uniquely occounted for, though, by the UG 
paradigm. For furtherdlscusslon. see Felix ( 1985b) and Bley-Vroman (1986a). 
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GRAMMATICALLY JUDGMENTS IN THE UG/L2 PARADIGM 

Much of the evidence for L2 learners' potential for accessing UG has been 
In the form of grammatlcallty judgments; that Is, experimental ellcltatlons 
of learner Intuitions for sentences compatible with, or In violation of, UG 
constraints. Grammatlcallty judgments are more expediently collected than 
natural production data, while ostensibly reflecting the systematic nature 
of learner "competence" rather than erratic "performance". Judgments of 
grammatlcallty, according to White (1985a: 37), constitute "a very 
Important source of data, a means to tap learner Intutlons about the L2/" 
The validity of such doio and their role In current grammatical theory are 
discussed at length In Newmeyer (1983, ch. 2), while a thorough review of 
Li and L2 research based on linguistic judgments appears In Chaudron 
(1983). Recent research within the UG/L2 paradigm has revealed that 
learners' Intuitions for the grammatlcallty or ungrammatlcallty of 
unfamiliar sentence types In a non-primary language are accurate, on the 
average, at a better-than-chence rate. Such performance suggests a basis 
for judgments other than knowledge of their native or target language. It Is 
argued that the basis for judgment is Universal Grammar, with the 
conclusion that UG can In fact be accessed by L2 learners. 

While better-than-chance accuracy on judgment tasks Is provocative, It 
Is unwise to view such performance as decisive. Our cautiousness derives 
from consideration of judgment vaiiabllty and, at the root of this 
variability, certain attested psycho/cognitive factors among subjects In 
judgment tasks. 

Salient examples of judgment variability are found In the Felix (1985a) 
study. Forty-eight native speakers of German were asked to judge 24 
English sentences; seven unfamiliar structural types were represented by 
four exemplars each. One-half of the stimuli sentences were grarr^atjcal, 
half were ungram natlcal. Overall, approximately 69% of stimuli tences 
were correctly judged; 80.5* of the ungrammatlcal sentences were properly 
rejected, while 57.5% of grammatical sentences were properly accepted. 
Though these figures seem quite Impressive, the variability behind the 
numbers hinders straightforward Interpretation. For example, across 
structural types, correct responses range from 58.6% for 
CONTROL/EXCEPTIONAL CASE MARKING sentences (see above) to 91% for 
CASE FILTER EFFECT sentences ('John seems to love Mary* versus '*Mary 
seems John to love'); within sentence types, correct responses range from 
29.2% proper acceptance to 95.8% proper rejection of PARASITIC GAP 
sentences fa person that they spoke to because they admired' versus '*a 



person that they spoke to because admired them'). After extensive 
discussion, Felix' response to such variable effects is the claim that 
learners access various UG principles at different times along a 
developmental sequence. However, such an argument does not square with 
data from adult English native speakers, v/ho presumably have completed 
their developmental sequence: within-type correct response rates for these 
"control" subjects ranged from 0% to 100% for PARASITIC GAP exemplars. 
Such results may be methodological artifacts (see discussion below). 

As for the difference in accuracy between stimulus sentences which are 
grammatical (57.5% correctly judged) and those which are ungrammatlcal 
(80.5% correctly judged), Felix maintains: 

Considering the theoretical status of UG within the logical problem of 
language acquisition, this is, in fact, what we would expect. The primary 
function of Universal Grammar is to provide the child with Information as 
to which structures are ^grammatical, since there is no other negative 
evidence available to the language learner. If a given construction violates 
[a] princfplels] of UG, the child will know for sure that this construction 
must be ungrammatlcal. If, in contrast, a structure does not violate UG, 
ft may still be unacceptable for other reasons. In other words, UG is an 
unambiguous source of information for 0?grammat1ca1U1es, but only a 
subsidiary source for identifying grammatical sentences. (1985a: 13) 

This appealing argument, for whatever its ultimate truth, falls to 
respond to a curious asymmetry in the response data: non-native subjects 
supplied the judgment, "ungrammatlcal" about 61.5% of the time, while 
judgments, "grammatical," constituted only 38.5% of the responses. 
Subjects faced with the task of making grammatical fty judgments may tend 
naturally to supply the judgment, "ungrammmatlcal," more often than the 
judgment, "grammatical" (see Chaudron 1983: 364); thus the accuracy rate 
for stimuli sentences which are indeed ungrammatlcal is predictably 
greater than that for grammatical sentences. Returning to the Felix data, 
when one compares the percentage of judgments "grammatical" (38.5%) to 
correct responses on grammatical stimuli (57.5%), the observed freqency of 
correct responses is superior to the expected frequency of correct 
responses by 19%; a similar comparison with judgments "ungrammatlcal" 
(61.5%) and observed accuracy (80.5%) yields an Identical 19% better-than- 
expected rate of accuracy. Thus It Is Inappropriate to claim that subjects' 
performance on ungrammatlcal Items was "superior to their performance on 
grammatical items. Such a claim ignores a fact of experimental 
performance, namely, subjects' bias toward supplying judqments 
"ungrammatlcal." 



One should not overlook, however, certain variability data which might 
support Felix' position concerning judgments of ungrammatlcal sentences. 
The 57.5* accuracy rate for grammatical stimuli embodies z staggering 
standard deviation across Items of 17.6, while the 80.5* figure for 
ungrammatlcal sentences reflects a relatively small standard deviation of 
10.5. Thus, compared to grammatical sentences, one may look with 
considerably more confidence on the accuracy rate for ungrammatlcal 
sentences. All things considered, though, the types and magnitude of 
variability in the Felix study make unambiguous interpretation next to 
Impossible. 

Numerous sorts of variability In metalinguistic judgment tasks are 
documented In Chaudron (1983), as are methodological sources of "noisy" 
judgment data. Subtle psychological and cognitive factors may also 
generate varlebllty in judgments. For example, Armstrong, Gleltman, and. 
Gleltman (1983) found that even for well-defined, nominal (binary) 
categories such as "even number," "odd number," "plane geometry figure," 
"female," "male," etc., subjects consider certain exemplars of a given 
category more representative or "better" members than others. In this 
study, subjects viewed numbers like 806 as "less even" than 4; trapezoids 
and ellipses are considered not as plane geometrical as squares; a princess 
Is deemed less representative of "female" than mothers and ballerinas. This 
supiislng effect was obtained not only In judgment tasks, but over a variety 
of experimental conditions (e.g., in timed verification tasks, subjects took 
longer to recognize the truth or falseness of statements like, "703 Is an odd 
number," than statements like, "9 Is an odd number"). Arguably, the 
variability attested for judgments of everyday nominal categories might 
apply to the category "grammatlcal/ungrammatlcal sentence." We should 
not be surprised, then, If some exemplars of a given grammatical constraint 
are judged more (or less) grammatical than others. One among many 
Illustrations of such Inter-Item variability Is available In judgments of 
violations of the (universal) Coordinate Structure Constraint. Informal 
surveys of learners and native speakers of English have revealed divergent 
rejection rates across tokens such as, "*Who did you see Mary and?", ""What 
Is it raining cats and?", and "*What did the grandfather clock stand between 
the bed and?" (see Ross, 1979). Note that the Inter-Item variability just 
described Is a fact of experimental performance, and may thus be considered 
Independently of rating variability attributable to "fuzzy" grammatical 
constraints (see Mohan 1977, Blrdsong 1984). Analysis and Interpretation 
of judgment data therefore critically hinge on the fundamental 
comparability of Items to be judged; at Issue Is nothing less than the 
Internal validity of the elicltation Instrument. 
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In a 198 1 study entitled, The non-uniqueness of linguistic Intuitions/ 
Carroll, Bever, and Pollack address psychological sources of Intro-subject 
variability. They find that It Is possible to Induce changes In native 
speakers' language judgment patterns by manipulating physical elements of 
the experimental setting. Patterns of response for Individual subjects 
were found to differ merely as a function of the presence or absence of a 
mirror in the room where the experiments took placet Once again, 
legitimate use of judgment data becomes a question of procedural control 
and caution. 

Vet, even when elaborate procedural safeguards are taken, subjects may 
perform In unexpected ways. In a study by Blrdsong et al. (1985), learners 
of French as a foreign language were Instructed to make grammatlcallty 
judgments solely on the basis of syntactic criteria, specifically, 'Words Out 
of Place, Missing Words, or Too Many Words'. A post-test of validity was 
carried out with deviant sentences which varied minimally by the 
morphology of their complementizers. Paired sentences such as, '*Vo1ld les 
enfants QUI Pierre a joue* avec eux hler* versus '*Vo11e les enfants QUE 
Pierre a joue* avec eux hler; '«Vo11a les enfants QUE Pierre a joue' avec hler* 
versus '*Vo11a les enfants LESQUELS Pierre a joue* avec hler", were 
differentially judged, despite explicit Instructions to focus on syntactic 
features. 



CONCLUSION 

Faced with a lack of uniform success among L2 acquirers, researchers 
seek evidence of the role of UG from experimental data. The most expedient 
source of such data, grammatlcallty judgments, proves to be rife with 
problems of reliability and validity. While data derived from novel, 
sophisticated ellcltatlon techniques appear more trustworthy (see, for 
example, Finer and Broselow 1986), the use of grammatlcallty judgments, 
with few If any methodological safeguards, continues. It Is Ironic that 
perhaps the most palpable Impediment to the development of a principled 
theory of L2 acquisition Is reliance on unprincipled data. 
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